REMARKS 

Claims 1, 3-9, and 11-18 are pending in the application. 

Applicants respectfully request that the Examiner reconsider the rejections to the claims 
in view of the discussion below. 

Claims 1, 3-9, and 11-18 stand rejected under 35 U.S.C. §112, second paragraph. 

Claims 1, 4-7, 9, and 12-17 stand rejected under 35 U.S.C. § 102(b) as anticipated by U.S. 
Patent No. 6,055,513 to Abe. 

Claims 3, 11, and 18 stand rejected under 35 U.S.C. §103(a) as unpatentable over Abe, in 
view of U.S. Patent No. 6,125,339 to Reiser et al., hereinafter, Reiser. 

Applicant respectfully traverses the rejections based on the following discussion. The 
following paragraphs are numbered for ease of future reference. 

I. The 35 U.S.C. §112, Second Paragraph, Rejection 

[0001] Claims 1, 3-9, and 11-18 stand rejected under 35 U.S.C. §112, second paragraph. 

[0002] It is a fact that the Final Office Action, mailed 06/10/2009, states, "The 
independent claims mention customer activities across multiple channels upon which promotions 
are targeted and delivered, however, it is unclear how a one-way channel such as a catalog or 
directed marketing piece can be used this way." (Office Action, page 2). 

[0003] As argued previously, Applicants respectfully submit that the Final Office Action 
and the Office Action, mailed 10/30/2008, read limitations into the independent claims that do 
not exist. 

[0004] It is a fact that independent claims 1 and 17 state in relevant part, "... receiving a 
request from said customer from one of said multiple channels; . . . and sending, by said 
computer, both a reply to said request and said channel-specific promotion to said customer". 

[0005] It is a fact that independent claim 5 similarly states in relevant part, "... an 
input/output interface for receiving a request from said customer from one of said multiple 
channels; ... a processor configured to: ... send both a reply to said request and said channel- 
specific promotion to said customer". 
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[0006] Applicants respectfully submit that the independent claims clearly describe, 
receiving a request from the customer from one of the multiple channels , and sending a reply to 
the customer, (emphases added). Applicants further respectfully submit that the independent 
claims do not impose the limitation of multiple channels constituting one-way channels, as 
suggested by the Office Actions. That is, the present invention may inter alia receive a customer 
request and send a reply via the same channel or a different channel. For example, a customer 
request may be received from one of the multiple channels, e.g., a direct mailing piece, and a 
reply sent by, e.g., a computer printed mailing piece or an e-mail. 

[0007] For at least the reasons outlined above, Applicants respectfully submit that to one 
of ordinary skill in the art, independent claims 1, 9, and 17, and dependent claims 3-8, 11-16, and 
18, particularly point out and distinctly claim the subject matter which Applicants regard as the 
invention. Therefore, Applicants further respectfully submit that claims 1, 3-9, and 11-18 fulfill 
the statutory requirements of 35 U.S.C. §1 12, second paragraph. Withdrawal of the rejection of 
claims 1, 3-9, and 11-18 is respectfully solicited. 

II. The Prior Art Rejections 

A. The 35 U.S.C. 102(b) Rejection over Abe 
1. The Abe Disclosure 

[0008] It is a fact that Abe discloses, "A system and method for sequential decision- 
making for customer relationship management includes providing customer data including 
stimulus-response history data, and automatically generating actionable rales based on the 
customer data. Further, automatically generating actionable rales may include estimating a value 
function using reinforcement learning." (Abstract). 

[0009] It is a fact that Abe discloses, "The present invention includes an inventive 
method for sequential decision making (e.g., sequential cost-sensitive decision making) for 
customer relationship management. The inventive method includes providing customer data 
(e.g., consumer data, client data, donor data, etc.) comprising stimulus-response history data, and 
automatically generating actionable rales based on the customer data. Further, automatically 
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generating actionable rules may include estimating a value function using reinforcement learning 

(e.g., reinforcement learning and dynamic programming) " (paragraph [0014]). 

[0010] It is a fact that Abe discloses, "Further, the actionable rules may be generated 
using reinforcement learning based on a Markov Decision Process model with function 
approximation. For example, the batch reinforcement learning with function approximation may 
be based on Q-learning and/or sarsa-learning. For example, the batch reinforcement learning may 
be based on training data including sequences of states, actions, and resulting rewards." 
(paragraph [0017]). 

[001 1] It is a fact that Abe discloses, "In another aspect, the inventive method may 
include preparing customer data including stimulus-response history data, and using the 
customer data to output instance-in-time targeting rules (e.g., of general if-then style), so as to 
approximately maximize expected cumulative profits over time." (paragraph [0018]). 

[0012] It is a fact that Abe discloses, "Further, the inventive method may be applied to 
cross-channel optimized marketing (CCOM). For example, the inventive method may include 
providing customer data including stimulus-response history data from a plurality of channels 
(e.g., "multiple" channels), integrating the customer data, and automatically generating channel 
specific actionable rules based on the customer data. For instance, in this case the method may 
optimize (e.g., nearly optimize) cross-channel cumulative profits." (paragraph [0019]). 

[0013] It is a fact that Abe discloses, "Further, providing customer data may include 
generating a sequence of event data which may include a customer's demographic features, and 
features, derived from the customer's stimulus -response history data, which collectively reflect 
the state of said customer at a certain point in time, an action (e.g., a marketing action) taken at 
or around that time by an entity (e.g., a seller such as a retailer), a response taken by the 
customer at or around a time of an event, and an amount of profit realized by the entity and 
associated with said action." (paragraph [0020]). 

[0014] It is a fact that Abe discloses, "Further, providing customer data may include 
selecting customer data. For example, a value estimation may repeatedly call a data selection 
module one or more times per each iteration of a value iteration. In addition, the data selection 
module may access a customer and transaction history data set stored in a data storage device, 
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and use a selection criteria to select a restricted subset for use in a value function estimation." 
(paragraph [0023]). 

[0015] It is a fact that Abe discloses, "In addition, an n-step look ahead may be used in a 
value function update procedure within a value estimation module, in combination with a 
selective sampling with n-step look ahead. Further, the customer data may include transaction 
history data from multiple channels. For instance, providing customer data may include selecting 
customer data by accessing a number of channel specific databases, and forming an effective 
joining of data using a form of customer identification as a key." (paragraph [0025]). 

[0016] It is a fact that Abe discloses, "In another aspect, the inventive system may 
include a customer transaction cache for storing customer transaction data including stimulus- 
response history data, a customer profile cache for receiving an output of the customer 
transaction cache and storing current customer profile data, and a customer relationship 
management system, for receiving an output of the customer profile cache and customer 
relationship management rules, and execute the action specified by a rule that is identified as 
applicable. In this system, for example, the customer relationship management rules may be 
automatically generated based on the customer transaction data." (paragraph [0029]). 

[0017] It is a fact that Abe discloses, "Batch Reinforcement Learning with Function 
Approximation [:] In the foregoing description of reinforcement learning, two simplifying 
assumptions were made that are not satisfied in the current setting. The first assumption is that 
the problem space consists of a reasonably small number of atomic states and actions. ... In 
many practical applications, including targeted marketing, it is natural to treat the state space as a 
feature space with a large number of both categorical and real-valued features. In such cases, the 
state space is prohibitively large to represent explicitly, which renders the above methods 
impractical." (paragraphs [0096]-[0097]). 

[0018] It is a fact that Abe discloses, "The second assumption that was made is the 
availability of online interaction with the environment. In applications like targeted marketing, 
this situation is typically not the case. In fact, it is quite the opposite. In targeted marketing, one 
usually has access to a very large amount of data accumulated from past transaction history from 
which an effective targeting strategy is to be derived. Moreover, the targeting strategy (i.e., the 
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policy) must make simultaneous decisions for an entire population of customers, [not] one 
customer at a time. Online learning of policies, via reinforcement learning or otherwise, is not 
practical under these circumstances." (paragraph [0098]). 

[0019] It is a fact that Abe discloses, "Bearing these factors in mind, the inventors 
propose to use so-called batch reinforcement learning methods with function approximation. 
Batch reinforcement learning refers to a form of reinforcement learning in which the learning 
does not take place in an online fashion as the learner performs actions and the environment 
traverses states. Instead, batch learning makes use of a potentially large volume of static training 
data that represents prior experience. The training data consists of sequences of states, actions, 
and resulting rewards. Batch learning thus reflects the realities of certain real- world applications 
like targeted marketing." (paragraph [0099]). 

[0020] It is a fact that Abe discloses, "Referring again to the drawings, FIG. 14 illustrates 
an inventive system 1400 for sequential decision making for customer relationship management 
according to the present invention. As shown in FIG. 14, the inventive system 1400 includes a 
database 1410 for storing customer data. As noted above, such data may include, for example, 
age, income, gender, etc., and stimulus-response history data. The system 1400 also includes a 
processor 1420 for automatically generating actionable (e.g., targeting) rules based on the 
customer data. Specifically, the processor 1420 may generate the actionable rules by estimating a 
value function using reinforcement learning (e.g., reinforcement learning and dynamic 
programming)." (paragraph [0167]). 

[0021] It is a fact that FIG. 14 of Abe discloses, 
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[0022] It is a fact that Abe discloses, "FIG. 15 illustrates one example of a system 
according to present invention. In this example, targeted marketing rules are automatically 
generated for customers. As shown in FIG. 15, the customer transaction data (1505) are 
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transformed to create derived features (1510). These features are used to develop current 
customer profile data (1570) and combined historical customer profile and stimulus response 
data (1515). Data mining (1520) is performed on this data (1515) to develop stimulus-response 
models (1525)." (paragraph [0169]). 

[0023] It is a fact that FIG. 15 of Abe discloses, 
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[0024] It is a fact that Abe discloses, "Further, blocks 1560, 1565, 1575, and 1580 
represent an exemplary embodiment of an operational CRM system for utilizing the targeting 
rules that are produced by the invention. This operational CRM system is depicted as having its 
own transaction (1580) and profile (1565) data caches in order to enhance its run-time execution 
speed by reducing the number of queries that would otherwise have to be issued against the main 
database (1505) if the data caches were not present." (paragraph [0177]). 

[0025] It is a fact that Abe discloses, "FIG. 24 illustrates one possible infrastructure for 
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the present invention including CCOM. For example, in this example, the channels include the 
web, kiosk, direct mail, a call center, and a store. The rules from the customer relationship 
management (CRM) rule base are applied to operational transactions to transform into customer 
profiles (e.g., operational and historical) at a point in time. The customer lifetime value is 
modeled to predict customer behavior. These models are transformed into situation-action rules 
which may be used to update the CRM rule base." (paragraph [0197]). 
[0026] It is a fact that FIG. 24 of Abe discloses, 



FIG.24 




2. Argument 

[0027] As argued previously, Abe discloses a system and method for sequential decision- 
making for customer relationship management that includes providing customer data including 
stimulus-response history data, and automatically generating actionable rules based on the 
customer data, in which automatically generating actionable rules may include estimating a value 
function using reinforcement learning. (Abstract). 
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[0028] As argued previously, Abe also discloses that generating the actionable rules, 
which result from reinforcement learning, does not take place in an online fashion (Paragraph 
[0099]), because (1) the prohibitively large state space for many customers over periods of time 
renders targeted marketing impractical (paragraphs [0096]-[0097]), and (2) online learning of 
policies, via reinforcement learning, is not practical for large populations of customers and their 
transaction histories (paragraph [0098]). To solve these problems, Abe proposes a so-called 
batch reinforcement learning methods with function approximation, in which the learning does 
not take place in an online fashion as the learner performs actions and the environment traverses 
states (paragraph [0099]). Batch functions, as is known to one of ordinary skill in the art and as 
described by Abe, do not respond to every individual request. Hence, Abe does not respond with 
targeted marketing to every request or transaction by a customer , as does the present invention. 

[0029] In contrast, the present invention, as argued previously, clearly claims at least the 
features of: "receiving a request from said customer from one of said multiple channels; ... 
updating said integrated belief profile , based on said stored belief values of said customer, before 
executing said request ; executing said request; simultaneously, with said executing of said 
request, generating a channel-specific promotion based on said updated integrated belief profile ", 
as recited in independent claims 1 and 17, and similarly recited in claim 9. (emphases added). 
That is, upon receiving a request, the present invention, in an online manner , updates the 
integrated belief profile (which is analogous to Abe's reinforcement learning), (emphasis added). 

[0030] For at least the reasons outlined above, Applicants respectfully submit, as 
previously argued, that not only does Abe not disclose, teach or suggest at least the present 
invention's features of: receiving a request from said customer from one of said multiple 
channels; . . . updating said integrated belief profile, based on said stored belief values of said 
customer, before executing said request; executing said request; simultaneously, with said 
executing of said request, generating a channel-specific promotion based on said updated 
integrated belief profile", as recited in previously presented, independent claims 1 and 17, and as 
similarly recited in previously presented, independent claim 9, but that Abe teaches away from 
the present invention by use of so-called batch reinforcement learning methods with function 
approximation, in which the learning does not take place in an online fashion as the learner 
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performs actions and the environment traverses states (Paragraph [0099]). Accordingly, Abe 
fails to anticipate the subject matter of previously presented, independent claims 1, 9, and 17, 
and dependent claims 4-7 and 12-16 under 35 U.S.C. § 102(b). Withdrawal of the rejection of 
claims 1, 4-7, 9, and 12-17 under 35 U.S.C. §102(b) as anticipated by Abe is respectfully 
solicited. 

B. The 35 U.S.C. 103(a) Rejection over Abe and Reiser 
1. The Reiser Disclosure 

[0031] It is a fact that Reiser discloses, "The present invention provides a method for 
automatically learning belief functions, thus providing the ability to determine erroneous 
information sources, inappropriate information combinations, and optimal information 
granularities, along with enhanced system performance. The present invention may be embodied 
in a method of training belief functions, including the steps of gathering information 
representative of an object or event; creating a set of basic probability assignments based on said 
set of information; creating combinations of said basic probability assignments; measuring an 
error present in said basic probability assignments and said combinations of basic probability 
assignments; calculating updates of said basic probability assignments and said combinations of 
basic probability assignments based on said error; and modifying said basic probability 
assignments and said combinations of basic probability assignments with said updates." (col. 2, 
lines 6-22). 

[0032] It is a fact that Reiser discloses, "As shown in FIG. 2, at block 100 the method 
polls the information sources 20 to extract information. The extracted information will be used to 
generate a belief function, or bpa. The output of each information source 20 is representative of 
an observation, a rule, an opinion, or some other measurable phenomenon. The polling of the 
information source 20 is no different for supervised or unsupervised learning methods. Block 
110 performs the function of gathering the information reported by the information sources 20, 
processing the information into bpa's, and combining the sensor bpa's in a predetermined fashion. 
For example, the bpa .mu..sub.l may be based on object shape. A second set of information 
sources 20, used to produce .mu..sub.2 may be based on object size, while a third bpa .mu..sub.3 
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may be based on the heat associated with the object. By combining the three bpa's (.mu..sub.l, 
.mu..sub.2, .mu..sub.3) via Dempster's rule of combination, which is well known in the art, a 
fourth bpa (.mu..sub.o) is created. This new bpa provides more information as to the identity of 
object being observed." (col. 3, lines 10-30). 

[0033] It is a fact that FIG. 2 of Reiser discloses, 



FIG. 2 




,140 



2. Argument 

[0034] As argued previously, Reiser does not cure the deficiencies of Abe argued above. 

[0035] Resier merely discloses combining belief function via Dempster' rule of 
combination while automatically learning belief functions, (col. 2, lines 6-22 and col. 3, lines 
10-30). 
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[0036] As argued previously, Applicants respectfully submit that nowhere does Reiser 
disclose, teach or suggest at least the present invention's features of: receiving a request from 
said customer from one of said multiple channels; ... updating said integrated belief profile, 
based on said stored belief values of said customer, before executing said request; executing said 
request; simultaneously, with said executing of said request, generating a channel- specific 
promotion based on said updated integrated belief profile", as recited in currently amended, 
independent claims 1 and 17, and as similarly recited in currently amended, independent claim 9. 

[0037] Instead, Reiser merely discloses combining belief function via Dempster' rule of 
combination while automatically learning belief functions, (col. 2, lines 6-22 and col. 3, lines 
10-30). 

[0038] For at least the reasons outline above with respect to the rejection of the claims 
over Abe, and for at least the reasons outlined above with respect to the rejection of the claims 
over Reiser, Applicants respectfully submit, as argued prevviously, that Abe and Reiser, either 
individually or in combination, do not disclose, teach or suggest at least the present invention's 
features of: receiving a request from said customer from one of said multiple channels; . . . 
updating said integrated belief profile, based on said stored belief values of said customer, before 
executing said request; executing said request; simultaneously, with said executing of said 
request, generating a channel-specific promotion based on said updated integrated belief profile", 
as recited in previously presented, independent claims 1 and 17, and as similarly recited in 
previously presented, independent claim 9. Accordingly, Abe and Reiser, either individually or 
in combination, fail to render obvious the subject matter of previously presented, independent 
claims 1, 9, and 17, and dependent claims 3, 11, and 18 under 35 U.S.C. §103(a). Withdrawal of 
the rejection of claims 3, 11, and 18 under 35 U.S.C. § 102(b) as unpatentable over Abe and 
Reiser is respectfully solicited. 
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III. Formal Matters and Conclusion 

Claims 1, 3-9, and 11-18 are pending in the application. 

Applicants respectfully submit that the present claims fulfill the statutory requirements of 
35 U.S.C. §112, second paragraph. 

With respect to the rejections of the claims over the cited prior art, Applicants 
respectfully argue that the present claims are distinguishable over the prior art of record. In view 
of the foregoing, the Examiner is respectfully requested to reconsider and withdraw the 
rejections to the claims. 

In view of the foregoing, Applicants submit that claims 1, 3-9, and 1 1-18, all the claims 
presently pending in the application, are in condition for allowance. The Examiner is 
respectfully requested to pass the above application to issue at the earliest time possible. 

Should the Examiner find the application to be other than in condition for allowance, the 
Examiner is requested to contact the undersigned at the local telephone number listed below to 
discuss any other changes deemed necessary. 

Please charge any deficiencies and credit any overpayments to Attorney's Deposit 
Account Number 09-0441. 

Respectfully submitted, 

Dated: August 4, 2009 /Peter A. Balnave/ 

Peter A. Balnave, Ph.D. 
Registration No. 46,199 

Gibb LP. Law Firm, LLC 

2568-A Riva Road, Suite 304 

Annapolis, MD 21401 

Voice: (410) 573-5255 

Fax: (301) 261-8825 

Email: Balnave@gibbiplaw.com 

Customer Number: 29154 
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